Imaging Array for Bird or Bat Detection and Identification

ABSTRACT

An automated system for mitigating risk from a wind farm. The automated system may include an array of a plurality of image capturing devices independently mounted in a wind farm. The array may include a plurality of low resolution cameras and at least one high resolution camera. The plurality of low resolution cameras may be interconnected and may detect a spherical field surrounding the wind farm. A server is in communication with the array of image capturing devices. The server may automatically analyze images to classify an airborne object captured by the array of image capturing devices in response to receiving the images.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/816,352 filed Nov. 17, 2017, which is a continuation of U.S. patentapplication Ser. No. 14/829,439 filed Aug. 18, 2015, now U.S. Pat. No.9,856,856 issued Jan. 2, 2018, which claims the benefit of, and priorityto, U.S. Provisional Patent Application No. 62/040,081 filed on Aug. 21,2014, each of which is herein incorporated by reference.

FIELD OF THE INVENTION

This disclosure relates generally to systems and methods for assessingand/or reducing risks to birds and/or bats.

BACKGROUND

It is often desirable to evaluate or survey the patterns, frequencies,and behaviors of flying species, such as birds or bats. For example, thespinning turbine blades of wind farms pose a risk to birds or bats thatfly through the volume swept by the turbine blades. Some governmententities may require wind farms to mitigate that risk, particularly forcertain bird or bat species protected by law or government regulations.For example, these government entities may require that mitigation ofthe risk to Golden Eagles or Bald Eagles from a proposed wind farm bedemonstrated before installation of the wind farm is permitted. Othergovernments may not require a permit, but may still issue penalties orfines for those wind farms that harm government identified birds orother animals.

Attempts to mitigate the risk posed by wind farms to protected bird orbat species typically involve curtailing (e.g., slowing or shuttingdown) operation of wind turbines when it is determined that protectedbirds or bats may be present. Existing mitigation methods typicallycannot specifically identify birds or bats that they detect, and maytherefore curtail operation of wind turbines more often than isnecessary to mitigate risk to protected bird and bat species. Thisresults in loss of energy and revenue. Further, existing mitigationmethods typically have a high capital cost.

SUMMARY

This specification discloses systems and methods that employ automatedoptical imaging technology to mitigate the risk posed by wind turbinesto protected bird and/or bat species, other types of objects, orcombinations thereof and related systems and methods that employautomated optical imaging to assess such risk prior to or afterconstruction of a wind farm by surveying bird and/or bat populations,surveying other types of risks, or combinations thereof in the vicinityof the wind farm site.

In one aspect of the invention, an automated system for mitigating riskfrom a wind turbine includes a plurality of optical imaging sensors anda controller. The controller is configured to automatically receive andanalyze images from the optical imaging sensors, to automatically send asignal to curtail operation of the wind turbine to a predetermined riskmitigating level when the controller determines from images from theoptical imaging sensors that an is at risk from the wind turbine, and tosubsequently automatically send a signal to resume normal operation ofthe wind turbine when the controller determines from additional imagesfrom the optical imaging sensors that there is no longer risk from thewind turbine to an airborne object of the one or more predeterminedspecies.

The controller may be configured to determine whether each bird or batit detects in images from the optical imaging sensors is a member of aparticular predetermined species before the detected bird or bat iscloser to the wind turbine than the distance the particularpredetermined species can fly at a characteristic speed of theparticular predetermined species in the time required to curtailoperation of the wind turbine to the predetermined risk mitigatinglevel. The characteristic speed of the particular predetermined speciesmay be, for example, the average horizontal flight speed of thepredetermined species or the maximum horizontal flight speed of thepredetermined species.

In some variations the predetermined species include Golden Eagles. Insome of these variations the controller determines whether each bird orbat it detects in images from the optical imaging sensors is a GoldenEagle before the detected bird or bat is closer than about 600 meters tothe wind turbine. The controller may detect at a distance greater thanabout 800 meters each bird or bat that it subsequently determines is aGolden Eagle.

In some variations the predetermined species include Bald Eagles. Insome of these variations the controller determines whether each bird orbat it detects in images from the optical imaging sensors is a BaldEagle before the detected bird or bat is closer than about 600 meters tothe wind turbine. The controller may detect at a distance greater thanabout 800 meters each bird or bat that it subsequently determines is aBald Eagle.

The plurality of optical imaging sensors may be arranged with a combinedfield of view of about 360 degrees or more around the wind turbine. Theoptical imaging sensors may be arranged with overlapping fields of view.In some variations, at least some of the optical imaging sensors areattached to a tower supporting the wind turbine. In some variations oneor more of the optical imaging sensors is arranged with a field of viewdirectly above the wind turbine.

The system may comprise a deterrent system configured to deploy birdand/or bat deterrents, such as flashing lights or sounds for example, todeter birds and/or bats from approaching the wind turbine. In suchvariations the controller may be configured to automatically send asignal to the deterrent system to deploy a bird or bat deterrent if thecontroller determines from images from the optical imaging sensors thata bird or bat of the one or more predetermined species is approachingthe wind turbine.

In another aspect, an automated system for mitigating risk from a windturbine to birds or bats of one or more predetermined species comprisesa plurality of optical imaging sensors and a controller. The controlleris configured to automatically receive and analyze images from theoptical imaging sensors and to automatically send a signal to thedeterrent system to deploy a bird or bat deterrent if the controllerdetermines from images from the optical imaging sensors that a bird orbat of the one or more predetermined species is approaching the windturbine.

The controller may be configured to determine whether each bird or batit detects in images from the optical imaging sensors is a member of aparticular predetermined species before the detected bird or bat iscloser to the wind turbine than the distance the particularpredetermined species can fly at a characteristic speed of theparticular predetermined species in the time required to curtailoperation of the wind turbine to a predetermined risk mitigating level.The characteristic speed of the particular predetermined species may be,for example, the average horizontal flight speed of the predeterminedspecies or the maximum horizontal flight speed of the predeterminedspecies.

In some variations the predetermined species include Golden Eagles. Insome of these variations the controller determines whether each bird orbat it detects in images from the optical imaging sensors is a GoldenEagle before the detected bird or bat is closer than about 600 meters tothe wind turbine. The controller may detect at a distance greater thanabout 800 meters each bird or bat that it subsequently determines is aGolden Eagle.

In some variations the predetermined species include Bald Eagles. Insome of these variations the controller determines whether each bird orbat it detects in images from the optical imaging sensors is a BaldEagle before the detected bird or bat is closer than about 600 meters tothe wind turbine. The controller may detect at a distance greater thanabout 800 meters each bird or bat that it subsequently determines is aBald Eagle.

The plurality of optical imaging sensors may be arranged with a combinedfield of view of about 360 degrees or more around the wind turbine. Theoptical imaging sensors may be arranged with overlapping fields of view.In some variations, at least some of the optical imaging sensors areattached to a tower supporting the wind turbine. In some variations oneor more of the optical imaging sensors is arranged with a field of viewdirectly above the wind turbine.

In another aspect, an automated system for surveying the population ofbirds or bats of one or more particular species of interest comprises aplurality of optical imaging sensors and a controller. The controller isconfigured to automatically receive and analyze images from the opticalimaging sensors and to automatically determine whether birds or batsdetected in images from the optical imaging sensors are members of theone or more particular species of interest. The particular species ofinterest may comprise, for example, Bald Eagles and/or Golden Eagles.

In one embodiment, an automated system for mitigating risk from a windfarm is described. The automated system may include an array of aplurality of image capturing devices independently mounted in a windfarm. The array may include a plurality of low resolution cameras and atleast one high resolution camera. The plurality of low resolutioncameras may be interconnected and may detect a spherical fieldsurrounding the wind farm. A server may be in communication with thearray of image capturing devices. The server may automatically analyzeimages to classify an airborne object captured by the array of imagecapturing devices in response to receiving the images.

The array of image capturing devices may coordinate the capturing of astereoscopic image of the airborne object. The server may be connectedto a plurality of wind towers, wherein the server may be capable ofinitiating mitigation efforts of the wind towers. The mitigationactivities may curtail functionality of blades of the wind tower. Themitigation activities may initiate one or more deterrent activities,wherein the deterrent activities may include flashing lights and sounds.

A plurality of towers may be strategically placed around the wind farmto provide 360 degrees of optical coverage of each wind tower in thewind farm. The plurality of towers may be equipped with the plurality ofimage capturing devices. The plurality of towers may be equipped withmeteorological instrumentation, the meteorological instruments may beconnected to the server. The meteorological instruments may streamweather conditions to the server. The server may be configured to usethe weather conditions to aid in identifying a behavioral pattern toclassify the flying object.

A radar system may be proximate the at least one high resolution camera.The at least one high resolution camera may be equipped with a pan andtilt system capable of near 360 motion. An observation zone may surroundeach plurality of image capturing devices, wherein each observation zonemay overlap. The array may further include at least one wide viewimaging system, the wide view imaging system may comprise a view rangebetween 180 degrees and 90 degrees.

In another embodiment, a method of mitigating risk from a wind farm isdescribed. The method may include detecting one or more airborne objectsthrough a low resolution camera, activating a high resolution camera toprovide improved imagery, and transmitting, automatically through acomputing device, improved imagery data to a cloud server. The methodmay include classifying, through the cloud server, the airborne objectbased at least in part on the improved imagery, monitoring the airborneobject with the high resolution camera as it enters a wind farm based atleast in part on the classification when the airborne object isclassified as at least one of the predetermined species. The method mayalso include activating mitigation efforts within the wind farm when theflying object meets a threshold classification and a threshold location.

The method may further include gathering one or more meteorological datapoints from one or more meteorological instruments proximate the highresolution camera and transmitting the meteorological data points to acloud server. A cloud server may analyze a behavior of the flying objectbased at least part on the meteorological data points. Image data andmeteorological data points may be streamed to the cloud server. Thecloud server may update a travel trajectory of the flying object and abehavioral categorization based at least in part on the streaming data.

Activating mitigation efforts may further include curtailing,automatically, operation of a wind tower based at least in part on thethreshold classification and threshold location. The threshold locationmay comprise a predetermined distance from a wind tower based at leastin part on a travel trajectory of the flying object and a travel speedof the flying object. An event log may be generated when a flying objectenters the wind farm. The event information may be recorded includingobject classification, travel information, and mitigation effortsrelating to the event. The event information may be stored in a cloudserver for a predetermined period of time. A location of the airborneobject may be determined using a radar system proximate the highresolution camera.

In another embodiment, an automated system for mitigating risk from awind farm is described. The automated system may include a plurality ofimage capturing devices independently mounted on a detection systemtower in a wind farm. The plurality of image capturing devices includinga plurality of low resolution cameras and at least one high resolutioncamera. The plurality of low resolution cameras may be interconnectedand may detect a spherical field surrounding the wind farm. A server maybe in communication with the array of image capturing devices. Theserver may analyze images to classify a flying object captured by thearray of imaging capturing devices in response to receiving the images.

These and other embodiments, features and advantages of the presentinvention will become more apparent to those skilled in the art whentaken with reference to the following more detailed description of theinvention in conjunction with the accompanying drawings that are firstbriefly described.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an exemplary side perspective view of a wind turbineillustrating a volume of space around the wind turbine defined by anexample bird or bat risk mitigation methods and systems disclosedherein.

FIG. 2 is an exemplary top perspective view of the wind turbine and birdor bat risk mitigation volume illustrated in FIG. 1.

FIG. 3 is an exemplary top perspective view of a wind farm illustratingrisk mitigation volumes defined by an example bird or bat riskmitigation methods and systems disclosed herein, as well as thetrajectory of a bird flying through the wind farm and triggeringcurtailment for some wind turbines but not others.

FIG. 4 shows an exemplary view of a wind turbine to which opticalimaging sensor modules are mounted according to an example bird or batrisk mitigation methods and systems disclosed herein.

FIG. 5 shows an exemplary view of a wind turbine to which opticalimaging sensor modules are mounted according to an example bird or batrisk mitigation methods and systems disclosed herein.

FIG. 6 shows an exemplary view of a wind turbine to which opticalimaging sensor modules are mounted according to an example bird or batrisk mitigation methods and systems disclosed herein.

FIG. 7 shows an example block diagram of a system for mitigating riskfrom a wind turbine to birds or bats disclosed herein.

FIG. 8 is a top perspective view of an example of a wind turbine farmwith an array of image capturing devices disclosed herein.

FIG. 9 shows an exemplary view of a detection system tower disclosedherein.

FIGS. 10A, 10B, 10C, 10D, and 10E show an exemplary graphical userinterface as disclosed herein.

FIG. 11 is an exemplary flow diagram pertaining to detection systems asdisclosed herein.

FIG. 12 is an exemplary flow diagram pertaining to detection systems asdisclosed herein.

DETAILED DESCRIPTION

The following detailed description should be read with reference to thedrawings, in which identical reference numbers refer to like elementsthroughout the different figures. The drawings, which are notnecessarily to scale, depict selective embodiments and are not intendedto limit the scope of the invention. The detailed descriptionillustrates by way of example, not by way of limitation, the principlesof the invention. This description will enable one skilled in the art tomake and use the invention, and describes several embodiments,adaptations, variations, alternatives and uses of the invention.

For the purposes of this disclosure, the term “airborne object”generally refers to animals or objects that employ aerial locomotion.This aerial locomotion may be powered or unpowered. These airborneobjects may include flying or gliding objects or animals such as birds,bats, insects, other types of mammals, other types of birds, drones,aircraft, projectiles, other types of airborne objects, or combinationsthereof.

Referring to FIG. 1 (side view) and FIG. 2 (top view), thisspecification discloses automated systems and methods that employoptical imaging technology to detect birds, bats, or other types ofobjects (e.g., bird 10) in flight near a wind turbine 100, determinewhether or not the detected bird, bat, or object is of one or moreparticular protected species or group requiring risk mitigation (e.g., aGolden Eagle, a Bald Eagle, government drone), and based on thatdetermination decide whether or not to curtail operation of the windturbine 100 and/or whether or not to employ deterrent measures to deterthe detected bird, bat, or object from approaching the wind turbine 100.The systems and methods may, for example, positively identify a detectedbird, bat, or object to be a member of a protected species or group forwhich risk is to be mitigated, positively identify a detected bird, bat,or object to be a member of a species for which risk need not bemitigated, or determine that a detected bird, bat, or object is not amember of a protected species or group for which risk is to be mitigatedwithout identifying the species of the bird, bat, or object. In somecases, a protected species is defined by a government in whichjurisdiction the wind farm is located. But, in other examples, thesystem may include a list of species that it classifies as a “protectedspecies.” In other examples, the species that are considered to be aprotected species may be based on international treaties,non-governmental organizations, protection groups, industry experts,scientific studies, religious groups, other individuals, otherorganizations, or combinations thereof

In these systems and methods the birds, bats, or object may be firstimaged at a distance from the wind turbine 100 greater than or equal toa distance R, and the decisions to curtail or not to curtail operationof the wind turbine 100 and to deploy or not to deploy deterrentmeasures may be made before the bird, bat, or object approaches closerthan distance R to the wind turbine 100. The distance R is selected toprovide sufficient time for operation of the wind turbine 100 to becurtailed before the detected bird or bat is likely to reach the volumeswept by the wind turbine blades 105, if the bird, bat, object is flyingtoward the wind turbine 100 at a speed characteristic of a protectedspecies for which risk is to be mitigated. A characteristic speed of abird or bat species may be, for example, an average horizontal flightspeed or a maximum horizontal flight speed.

Hence the distance R may be selected, for example, to be greater than orequal to the distance that a bird or bat of the protected species forwhich risk is to be mitigated can fly at that species' known averagehorizontal flight speed in the time interval required to curtailoperation of the wind turbine 100. Alternatively, the distance R may beselected for example to be greater than or equal to the distance that abird or bat of the protected species for which risk is to be mitigatedcan fly at that species' known maximum horizontal flight speed in thetime interval required to curtail operation of the wind turbine.

If the methods and systems are used to mitigate risk from the windturbine 100 for more than one protected species of bird and/or bat, Rmay be determined for example using a characteristic speed of thefastest of the protected species for which risk is to be mitigated.Alternatively, a separate distance R may be determined for eachprotected species for which risk is to be mitigated.

The distance R may be measured for example from near the base of thewind turbine tower 110 as shown in FIG. 1, from the wind turbine nacelle115, or from any other suitable location on the wind turbine or itssupport structure. R may conveniently be measured from at or near thelocation of one or more optical imaging sensors (further describedbelow) employed in the systems and methods, but this is not required. Inthe illustrated example, R defines the boundary of a substantiallyhemispherical mitigation volume 120 around the wind turbine 100. Similarprotocols may be employed for determine the speed of approachingairborne objects.

Wind turbines with which the systems and methods of this disclosure maybe employed may have tower 110 heights of, for example, about 60 metersto about 120 meters and blade 105 lengths of, for example, about 40meters to about 65 meters. Rotation of the blades 105 of such windturbines 100 may be reduced from a normal operating speed of, forexample, about 6 to about 20 revolutions per minute (rpm) o about 1 rpmor less (e.g., to 0 rpm) in a time period (curtailment time) of, forexample, less than about 20 seconds, or less than about 30 seconds. Arotation speed of about 1 rpm or less for such wind turbines 100 may bedeemed by regulatory authorities to pose an acceptable risk togovernment-protected bird and bat species. Full curtailment to 0 rpm maybe preferable and obtainable in these time intervals. While the aboveexamples have been described with a specific type of windmill tower, anyappropriate type of windmill tower may be used in accordance with theprinciples described in the present disclosure. For example, the towerheight may exceed 120 meters and/or the blade length may exceed 65meters. Further, the normal operating speed of the wind turbines and thecurtailment speeds may be outside of the parameters described above.Also, the windmill's turbines may operate at the curtailment speeds forany appropriate amount of time.

As examples, Golden Eagles have an average horizontal flight speed ofabout 13.5 meters/second and Bald Eagles have an average horizontalflight speed of about 18.0 meters/second. Using these speeds, a value ofR equal to about 800 meters would provide about 44 seconds in which tocurtail the wind turbine 100 for a Bald Eagle and about 59 seconds inwhich to curtail the wind turbine 100 for a Golden Eagle. A value of Requal to about 600 meters would provide about 33 seconds in which tocurtail the wind turbine 100 for a Bald Eagle, and about 44 seconds inwhich to curtail the wind turbine 100 for a Golden Eagle. These valuesfor R thus likely provide sufficient time in which to curtail operationof a wind turbine 100 to about 1 rpm or less (e.g., to about 0 rpm), andhence are likely suitable for mitigating risk to Golden Eagles and BaldEagles using the systems and methods of the present disclosure.

Referring now to the schematic block diagram of FIG. 7, the bird and batrisk mitigation systems of the present disclosure may include one ormore optical sensors (e.g., digital cameras) 122 located on or near awind turbine 100, one or more bird, bat, and/or object deterrent systems124, one or more meteorological instrumentation 126, and one or morecontrollers 123 in communication with the wind turbine 100, the opticalsensors 122, meteorological instruments 126, and the deterrent systems124. The optical sensors 122 image birds and/or bats in flight near thewind turbine 100 and provide the images to the controller 123. Thecontroller 123 may implement an algorithm that determines whether or notan imaged bird or bat is of one or more particular protected speciesrequiring risk mitigation and whether or not the imaged bird or bat isapproaching the wind turbine 100. If the controller 123 determines thatan imaged bird or bat is of a protected species for which risk is to bemitigated, and determines that the imaged bird or bat is approaching thewind turbine 100 or is likely to approach dangerously close to the windturbine 100, the controller 123 signals the wind turbine 100 to curtailoperation, or signals the deterrent system 124 to deploy deterrentmeasures to deter the bird or bat from further approaching the windturbine 100, or signals the wind turbine 100 to begin curtailing itsoperation and signals the deterrent system 124 to deploy deterrentmeasures.

For example, the controller 123 may determine that an imaged bird or batis of one or more protected species requiring risk mitigation and isapproaching the wind turbine 100. While the bird or bat is still at adistance greater than R (defined above), the controller 123 may signal adeterrent system 124 to deploy a deterrent measure in an attempt todeter the bird or bat from further approaching the wind turbine 100. Ifthe controller 123 determines from further images from the opticalsensors 122 that the bird or bat was successfully deterred from furtherapproaching the wind turbine 100, the controller 123 may then determinethat it is not necessary to curtail operation of the wind turbine 100.If the controller 123 determines instead that the deterrent measureswere not successful and that the bird or the bat continues to approachthe wind turbine 100, the controller 123 may signal the wind turbine 100or a wind farm operator to curtail operation. The controller 123 may,for example, in addition control the deterrent system 124 to continue todeploy deterrent measures while the bird or bat is within a distance Rof the wind turbine 100. If operation of the wind turbine 100 iscurtailed, after the controller 123 determines from further images fromthe optical sensors 122 that the bird or bat has left the proximity ofthe wind turbine 100 and is no longer at risk the controller 123 maysignal the wind turbine 100 to resume normal operation and signal thedeterrent system 124 to cease deploying deterrent measures.

In some examples, the signals may be sent directly to a windmill toinitiate either the deterrent operations or the curtailment operations.In other examples, the signals may be sent to an operator of thewindmills where the signals provide information that can be used by theoperator to decide whether to send commands to the windmill to initiatethe deterrent system or the curtailment system. In these examples, thesesignals may include details about whether a criterion for determent orcurtailment has been met. For example, the signal may include a messageexplaining a bird is within 600 meters of a particular turbine. In thatsituation, the operator may study the behavior of the bird through thecameras in the windfarm and decide whether to initiate the curtailmentor determent operations. In other examples, the signal may include amessage that includes a recommendation with the details about thecriterion. In this situations, the operator can still decide whether tosend commands to the turbine to execute the determent and/or curtailmentoperations. In one such example, the message may explain that a bird iswithin 600 meters of the turbine and is kiting-soaring with tis headdown in hunting mode, which meets the curtailment prescription. Inanother example, the signal may include a message that explains that abird is within 600 meters of the turbine and is unidirectionalflapping-gliding with its head up, which is interpreted to be in saferstatus and curtailment prescriptions are not met. In each of thesesituations, the operator may make the decision to take further action.But, in other examples, the signals may be sent directly to thewindmills of interest without a human making a decision.

The system just described may employ deterrent measures and may curtailoperation of a wind turbine to mitigate risk to a bird or bat of apredetermined protected species. Other variations of such systems may beconfigured only to employ deterrent measures as described above and notto curtail operation of the wind turbine. Yet other variations of suchsystems may be configured to curtail operation of a wind turbine asdescribed above, but not to employ deterrent measures.

Optical sensors 122 employed in these systems may include, for example,one or more wide angle field of view (WFOV) cameras mounted with fixedfields of view for object detection and two or more high resolutioncameras mounted to pan and tilt so as to be capable of tracking andidentifying a bird or bat as it approaches or passes near the windturbine 100. The WFOV cameras may be arranged so that their combinedfields of view provide 360 degrees of coverage in many directions aroundthe wind turbine 100. Thus, the combined fields may include a sphericalvision around the windfarm. The cameras may have the ability to move totilt upward, tilt downward, rotate, or otherwise move. One or moreadditional WFOV cameras may be arranged with their fields of viewpointed upward to provide, in combination with the other WFOV cameras,substantially hemispherical coverage as depicted in FIG. 1 in themitigation volume (e.g. 120). The tracking cameras may be arranged toenable tracking and identification of birds or bats in the combinedfield of view of the WFOV cameras.

The WFOV cameras may be configured to image birds or bats for which riskis to be mitigated at a distance greater than R (defined above), forexample at a distance between about 600 meters and about 1000 meters, toprovide at least a low resolution blob-like image of the bird or bat.The WFOV cameras may additionally recognize other flying objects andhave the capability of initially determining if the flying object is ananimal or a non-living object.

The panning high resolution cameras are configured to image the detectedbirds or bats at a distance greater than R (e.g., between about 600meters and about 1000 meters) with sufficiently high resolution toprovide information on size, shape, color, flight characteristics,and/or other features by which it may be determined whether or not theimaged bird or bat is a member of a protected species for which risk isto be mitigated. The panning high resolution cameras may be arranged(e.g., in pairs) with overlapping fields of view to provide stereoscopicimaging of the birds or bats from which the distance to the bird or batand its speed and direction of motion (velocity) may be determined.While these examples have been described with specific detectiondistances, any appropriate detection distances may be used in accordancewith the principles described in this disclosure. For example, the WFOVoptical imaging sensors, the high resolution cameras, or the lowresolution cameras may be able to capture images of the airborne objectsat distances greater than a 1000 meters. In some examples, the highresolution camera can capture images of airborne objects in distancesbetween 1000 and 10000 meters.

Any suitable cameras or other optical imaging sensors 122 may beemployed for the WFOV optical imaging sensors and the panning opticalimaging sensors. The optical imaging sensors may generate images fromvisible light, but the optical imaging sensors may additionally and/oralternatively be configured to image birds or bats at infraredwavelengths to provide images at night.

In some variations, an optical sensor 122 includes one or more WFOVcameras arranged to provide general object or blob-like visual detectionand two or more high resolution cameras arranged to provide stereoscopicimaging from overlapping fields of view to track birds or bats flying inthe field of view of the WFOV cameras. Two or more such modules may bedeployed on or around a wind turbine to provide the 360 degree coveragedescribed above.

The meteorological instrumentation 126 may measure climate conditions topredict and/or identify the bird or bat or the behavior of the creature.The meteorological instruments 126 may include at least one of abarometer, ceilometer, humidity detector, rain and precipitation sensor,visibility sensor, wind sensor, temperature sensor, and the like.Specific environmental and climate conditions may determine animalbehavior. For example, wind speed and temperature conditions may affectbat feeding behavior. The metrological instrumentation 126 may alsocollect seasonal information.

Any suitable controller 123 may be used to control bird and/or bat riskmitigation for the wind turbine. The controller 123 may include, forexample, a processor and associated memory and input/output ports orwireless receivers and transmitters configured to communicate with thewind turbine 100, the optical sensors 122, the meteorologicalinstruments 126, and the deterrent system 124. The controller 123 may beor include a programmable computer, for example. The system may includea separate controller for each wind turbine. Alternatively, a singlecontroller 123 may control risk mitigation for two or more windturbines. A controller 123 may be located on a wind turbine, or anywhereelse suitable. A controller 123 may communicate with its associatedoptical sensors 122 and wind turbine 100 (or wind turbines) wirelessly,or through optical or electrical cable for example. The controller 123may additionally tap into a fiber system associated with the wind tower110 and wind farm.

The controller 123 may implement an algorithm in which it receives fromthe WFOV camera or cameras images in which it detects a bird or bat at adistance greater than R from a wind turbine 100. The controller 123 thencontrols the one or more high-resolution tracking (e.g., pan/tilt)cameras to track the bird or bat and collect and analyze high resolutionimages from which the controller 123 determines the distance to the birdor bat, its speed and direction of travel, and its height above groundlevel. The controller 123 may also determine from the high resolutionimages whether or not the bird or bat is of a protected species forwhich risk is to be mitigated (e.g., whether or not it is a Golden Eagleor a Bald Eagle). The controller 123 may make the determination based oncolor, shape, size (e.g., wing span), flight characteristics (e.g.,speed, wing motion and/or wing beat frequency), and/or any othersuitable features of the bird or bat. If the bird or bat is a member ofa protected species for which risk is to be mitigated and is approachingdangerously close to the wind turbine 100 or likely to approachdangerously close to the wind turbine 100, the controller 123 signalsthe wind turbine 100 to curtail operation and/or signals a deterrentsystem 124 to deploy a deterrent measure as described above. Ifoperation of the wind turbine 100 is curtailed, after curtailing thewind turbine 100, the controller 123 may continue to track the bird orbat with one or more tracking high-resolution cameras through theoptical sensors 122 and collect and analyze images of the bird or batfrom the one or more WFOV cameras and the one or more trackinghigh-resolution cameras until the bird or bat is no longer at risk fromthe wind turbine 100. For example, until the bird or bat is sufficientlyfar from the wind turbine 100 (e.g., >R) and moving away from the windturbine 100. When the bird or bat is no longer at risk, the controller123 signals the wind turbine 100 to resume normal operation.

The controller 123 may additionally receive information from themeteorological instruments 126 to help determine the behavior of thebird or bat. The types of weather conditions collected by themeteorological instrumentation 126 may provide additional information tothe controller 123 to determine if the bird or bat will undertakeavoidance measures. Wind speed and temperature conditions may beparticular to bat feeding behavior. Seasonal information may beindicative of migratory behavior. Other factors may also be indicativeof migratory behavior such as the nature of the airborne object'sflight, flight patterns, other factors, or combinations thereof.

The controller 123 may use the additional information to make inferenceson the behavior of the bird or bat. For example, a hunting bird or batmay be at higher risk for collision with a wind tower 110. The huntingbehavior may cause the creature to not notice the wind tower 110 and maycreate an increased risk. The controller 123 may initiate curtailmentand deterrent system 124 sooner if a hunting behavior is detected.Alternatively, if the controller 123 determines the bird or bat is in amigratory or travel pattern, the controller 123 may delay curtailmentand deterrence. The migratory and/or traveling creature may be morelikely to notice the wind tower 110 and naturally avoid the structure.The behaviors of the bird may be classified to assist in determiningwhether the birds are demonstrating hunting behavior, migratorybehavior, other types of behavior, or combinations thereof. Examples ofbehavior categories may include perching, soaring, flapping, flushed,circle soaring, hovering, diving, gliding, unidirectionalflapping-gliding, kiting-hovering, stooping or diving at prey, stoopingor diving in an agonistic context with other eagles or other birdspecies, undulating/territorial flight, another type of behavior, orcombinations thereof. Behavior and activity prevalent duringpredetermined intervals (e.g. one minute intervals) can recorded as partof an information gathering protocol. As the bird's behavior is followedover a predetermined amount of time, the bird's behavior type can bepredicted.

Deterrent system 124 may be configured to deploy bird and/or batdeterrents. This deterrents may include flashing lights and sounds todeter bird, bats or other animals. The deterrent system 124 may includelights, sounds, radio transmissions, or other types of signals inanimateairborne objects.

In one variation of the systems and methods just described, the WFOVcameras may detect and image birds that may be Golden Eagles or BaldEagles at a distance of about 1000 meters or more from the wind turbine100. After or upon detection of the bird with the WFOV cameras, one ormore tracking high resolution cameras may begin tracking the bird at adistance of about 800 meters or more from the wind turbine 100. Based onthe images from the WFOV and tracking cameras, the controller 123determines whether or not to curtail operation of the wind turbine 100and/or whether or not to deploy deterrent measures, and accordinglysignals the wind turbine 100 and/or the deterrent system 124 before thebird is closer than about 600 meters to the wind turbine 100.

With the systems and methods of the present disclosure, wind turbines ina wind farm may be individually curtailed and then returned to normaloperation as a protected bird or bat for which risk is to be mitigatedpasses into and out of the individual wind turbine mitigation volumes.For example, the wind farm depicted in FIG. 3 includes wind turbines 100a-100 e, each having a corresponding mitigation volume 120 a-120 e. Asbird 10 (for this example, a Golden Eagle) flies through the wind farm,it initially approaches wind turbine 100 b. Before the bird 10 entersmitigation volume 120 b, it is identified as a Golden Eagle and windturbine 100 b is instructed to curtail operation. As or after the GoldenEagle exits volume 1 20 b toward wind turbine 100 d, wind turbine 100 bis instructed to resume normal operation. Operation of wind turbine 100d is then similarly curtailed, and then restored to normal after therisk to the Golden Eagle has passed. Operation of wind turbines 100 a,100 c, and 100 e are not affected by passage of the Golden Eagle.

The systems mounted on the wind tower 110 may require a source ofelectricity to function. For example, the deterrent system 124,controller 123, optical sensors 122, and meteorological instruments 126may all be mounted on the wind tower 110. The systems may requireelectricity to properly function. The electricity may be supplied in amultitude of ways. The systems may tap into the wind tower 110 itselfand draw electricity that is generated by the wind tower 110. Thesystems may be hardwired into an electrical grid which may provide acontinuous power source. The systems may additionally be solar powered.The wind tower 110 may be equipped with solar panels which may fuel thesystems or the solar panels may be mounted in a nearby location and maybe wired to the systems to provide power. Additionally and/oralternatively, the systems may be battery-powered. For example, thesystems may run on an independent power system such as a fuel cell orsimilar battery function. In another embodiment, the systems may draw aprimary source of electricity from one of the sources mentioned hereinand may draw back-up electricity from a battery. The battery may besupplied by solar panels, the wind tower, and the like and may storeexcess energy for the systems to use when a main source of power isinadequate or non-functioning. The battery may be located directly onthe wind tower 110 or may be located at a nearby location and wired tothe systems as appropriate. In yet other examples, the system may bepowered by a small wind generator, the grid, a fuel cell generator,another type of generator, batteries, another type of power source, orcombinations thereof

Although in the example of FIG. 3 the diameters of the mitigationvolumes are shown as less than the spacing between wind turbines thisneed not be the case. The mitigation volumes of different wind turbinesin a wind farm may overlap.

Referring now to FIG. 4 and FIG. 5, some variations of the methods andsystems just described employ two or more optical imaging sensor modules125 attached to a wind turbine tower 110 at a height H above groundlevel. Height H may be, for example, about 5 meters to about 30 meters,for example about 10 meters. The optical imaging sensor modules 125 arearranged around the wind turbine tower 110 to provide a 360 degree fieldof view as measured in a horizontal plane perpendicular to the tower110. The field of view may also include a vertical component so that theairborne objects located higher or lower than the cameras are alsodetected by the camera. In these examples, the cameras may be located atdifferent heights or have an ability to tilt upwards or downwards. (Thearrows shown emanating from the optical imaging sensor modules 125schematically indicate a portion of their fields of view parallel to thetower 110). The illustrated example employs four such optical imagingsensor modules 125 arranged around the tower 110 with a spacing of about90 degrees between modules. Any other suitable number and spacing ofsuch optical sensing modules 125 may also be used.

Each optical imaging sensor module 125 may include one WFOV camera andtwo tracking high resolution cameras arranged with overlapping fields ofview to provide stereoscopic imaging and to track birds or bats flyingin the field of view of the WFOV camera.

As shown in FIG. 4 and FIG. 6, an additional optical imaging sensormodule 130 may be located on top of the wind turbine 100 (e.g., attachedto the top of the nacelle 115) with cameras pointed generally upward toprovide visual coverage directly above the wind turbine 100. Opticalimaging sensor module 130 may be identical to optical imaging sensormodules 125. Alternatively, optical imaging sensor module 130 may differfrom modules 125, for example, the optical imagine sensor module 130 mayinclude additional WFOV cameras. Any other suitable arrangement ofoptical imaging sensor modules 125, 130 may also be used.

Additional automated systems and methods may employ optical imagingtechnology similarly as described above to conduct bird and/or batpopulation surveys prior to or after construction of a wind turbine orwind turbine farm. Such automated surveys may determine, for example,the populations or observations of the presence and movements ofparticular protected species of birds and/or bats (e.g., Bald Eaglesand/or Golden Eagles) in an area in which a wind farm is to beconstructed or has already been constructed. A decision as to whether ornot to construct a wind farm may be based or partially based on theresults of such an automated survey. Similarly, a decision as to whetheror not to install a risk mitigation system at a proposed or an existingwind farm, such as those described above for example, may be based orpartially based on such an automated survey. Such systems and methodsmay be employed for onshore and/or offshore wind sites.

Such an automated bird and/or bat surveying system may include, forexample, one or more WFOV cameras as described above, and two or moretracking high-resolution cameras arranged as described above to trackbirds or bats in the field of view of the one or more WFOV cameras. Forexample, the system may include one or more optical sensor modules 125as described above. The system may also comprise a controller, forexample similar to controller 123 described above, in communication withthe cameras. The controller may implement an algorithm in which itreceives from the WFOV camera or cameras images in which it detects abird or bat. The controller may then control the one or morehigh-resolution tracking (e.g., pan/tilt) cameras to track the bird orbat and collect and analyze high resolution images from which thecontroller determines whether or not the bird or bat is of a particularspecies of interest (e.g., a protected species for which risk is to bemitigated). The controller may make that determination based, forexample, on color, shape, size (e.g., wing span), flight characteristics(e.g., speed, wing motion and/or wing beat frequency), and/or any othersuitable features of the bird or bat. For example, the controller maydetermine whether or not a detected bird is a Golden Eagle or a BaldEagle. If the detected bird or bat is a member of the species ofinterest, the controller may for example record images of andinformation about the detected bird or bat on a hard drive or in othermemory medium, or transmit such images and/or information to anotherdevice for storage. The controller may for example count the number ofinstances in which birds or bats of the particular species of interestare detected.

In the embodiments described above, a detection system may beindividually installed on each wind tower. In another embodiment, asshown in FIG. 8, a detection system 134 may be independently mounted ina wind farm 132. For example, each detection system 134 may have its owntower, without any turbine blades, on which it is mounted. The detectionsystem 134 may be scattered throughout the wind farm 132 to providecomprehension detection coverage for birds and bats. The detectionsystem 134 may be strategically placed to provide maximum detectioncapabilities without the need of duplicative systems. This may reduce acost associated with installing and maintaining the detection systems.For example, as shown in FIG. 8, there are five wind towers but onlythree strategically place detections system 134. An observation zone 135coverage area 135 for each tower encompasses the entirety of the windfarm 132.

The location of the detection system 134 may depend upon the location ofa wind tower 110, local topography, weather conditions, visibilityconditions, and the like. The local topography may determine where adetection system 134 may be mounted, the visibility surrounding thedetection system 134, and the like. The detection system 134 may beplaced to provide optimal vision of the wind farm 132 and the mitigationvolume 120 surrounding each wind tower 110. The visibility mayadditionally or alternatively be determined by local manmade structuressuch as buildings, or natural features such as trees, hills, mountains,and the like. Additionally, the local topography may also dictate amounting surface for a tower for the detection system 134. The detectionsystem tower (e.g. detection system tower 136 discussed with referenceto FIG. 9) is mounted on the surface of the earth to provide a stablestructure. The topography may allow for the drilling, mounting, andinterface of the tower to the earth's surface and may additionallydictate location of the detection system tower 136.

Power and data connectivity may also influence the location of adetection system 134. As mentioned previously, the detection system 134may be powered one of several ways. For example, the detection system134 may use solar power, may tap into the wind tower electrical system,may use a battery such as a fuel cell or the like. Depending upon thetype of power desired and the environmental conditions may dictate thelocation of the detection system 134. Additionally, the detection system134 may connect to a central database to one or more other detectionsystems. The detection system may use a wired or wireless system toconnect to the other portions of the system. The type of connectivitymay determine the location of the detection system 134.

As shown in FIG. 9, the detection system tower 136 may resemble windturbine tower (e.g., wind turbine tower 110, FIG. 1). The height of thedetection system column 138 may be at least 5 meters high. The height ofthe column 138 may vary depending upon the mounting location,visibility, and other factors discussed with reference to FIG. 8. Thecolumn 138 may include a mounting platform 140 which provide a stablesurface for the detection system 134.

Each tower 136 may include a detection system 134 with a series of lowresolution and high resolution imaging systems. The low resolutionimaging system may include wide view lenses to provide 360 degreeimaging coverage surrounding the tower 136. The number of low resolutionimaging systems to accomplish this may vary. In one embodiment, six lowresolution imaging systems may provide total coverage. In anotherembodiment, more or less low resolution imaging systems may be mountedto provide complete coverage. In still another embodiment, the tower 136may coordinate coverage with another tower 136. Therefore, theindividual tower may not have 360 degree coverage but, in combinationwith an array of detection system towers 136, the entire wind farm(e.g., wind farm 132) may be covered with image capturing devices.

Each tower 136 may additionally include at least one high resolutionimaging system. In some embodiments, multiple high resolution imagingsystems may be mounted. The number of high resolution imaging systemsindividually mounted on the tower 136 may depend upon the location ofthe tower 136 in relation to other detection system towers 136 and thewind farm 132 in general. The high resolution imaging system may includestereoscopic technology. Stereoscopic technology may combine the use ofmultiple photographs of the same object taken at different angles tocreate an impression of depth and solidity. The high resolution imagingsystem may use at least two high resolution cameras mounted on a singletower, or may combine imagines from multiple detection system towers toprovide the same or similar information. The stereoscopic technology mayprovide a better image of a bird or bat which may provide more efficientrecognition capabilities. The recognition capabilities, as describedpreviously, may include species of animal, status of animal (i.e.,hunting, migrating, traveling, etc.), geographic location, altitude ofanimal, speed, flight direction, and the like.

The high resolution imaging system may include a pan and/or tiltconfiguration. For example, the low resolution imaging system may detecta moving object within a predetermined distance from the wind farm 132.The high resolution imaging system may use a pan and/or tiltconfiguration to isolate the moving object and gather data concerningthe object to categorize it. As mentioned previously, the moving objectmay be a leaf or other nonliving object. Alternatively, the movingobject may be a living creature and may be positively identified. Thepan and/or tilt feature of the high resolution imaging system may enablemore precise images of the object to be captured for furtherclarification. The high resolution imaging system may maneuver to gain abetter image of the object, track the object if the object is moving,and the like. The pan/tilt may allow near 360 motion of the highresolution camera such that the camera is able to capture images ofobjects within an observation zone 135 surrounding the tower 136. Insome instances, the high resolution imaging systems may be equipped withadditional capabilities such as a range finder, a radar system, and thelike. The additional capabilities may provide more information forpotential mitigation efforts.

In one embodiment, the tower 136 may additionally include meteorologicalinstruments and equipment. The meteorological equipment may measureclimate conditions to predict and/or identify the bird or bat and thestate of the animal. The meteorological instruments and equipment mayinclude barometers, ceilometers, humidity detectors, rain andprecipitation sensors, visibility sensors, wind sensors, temperaturesensors, and the like. Specific environmental and climate conditions maydetermine animal behavior. For example, as mentioned previously, windspeed and temperature conditions may affect bat feeding behavior.Seasonal information may also be gathered to help determine animalbehavior. A migratory bird is more likely to be seen in the spring andin the fall than in the middle of the winter and/or summer.

In another embodiment, a tower 136 may be equipped either additionallyand/or alternatively with wide view imaging systems. The wide viewimaging systems may be equipped with a view range between 180 and 90degrees, and sometimes closer to 120 degrees. The wide view imagingsystems may be mounted on a periphery of the wind farm 132 to provide aninitial view of birds or bats prior to the animals entry to the windfarm 132 and/or mitigation volume surrounding the wind tower (e.g.mitigation volume 120 surrounding wind tower 110). The wide field towersystems may triangulate between each other to positively capture thefield and provide more substantive information to high resolutionimaging systems. This type of system may reduce the need for repetitivedetection systems and allow a wind farm 132 to provide safe passage forflying animals without undue cost.

The wide field tower systems may additionally use multiple images frommultiple towers to determine a location of the flying object and adistance from any of the cameras. For example, by using multiple images,a controller and/or computer system may generate a stereoscopic imagewhich enable the computing device to determine a distance from theflying object to the camera system. Once the location and distance ofthe flying object is known, a high resolution camera may zoom in on theflying object. The high resolution camera may be enabled with a tilt,zoom, rotatable mounting device, and the like. The high resolutioncamera may rotate and tilt until it is able to capture an image of theflying object. The computing device may automatically initiate the highresolution camera to move appropriately to capture the flying object ora person may use the information to command the camera. The highresolution camera may capture an image of the flying object. The imagecaptured by the high resolution camera may be a higher quality, forexample, the image captured by the high resolution camera may containmore pixels than the images captured by the wide view cameras.

The higher resolution images may enable the computing device and/or ascientist or other personnel to determine characteristics of the flyingobject. For example, the image may provide information pertaining to thecolor, size, shape, behavior, and the like. If the flying object is ananimal, the characteristics may enable a classification of the object.Alternatively, if the flying object is not an animal, thecharacteristics may enable personnel and/or a computing device todetermine if the flying object poses a threat to the wind farm.

This system may enable a cost savings over traditional systems. Widefield view cameras may spot objects further away and have a greaterviewing periphery enabling fewer cameras to be used. The high resolutioncameras may be intermittently mounted within the wind farm to providehigh resolution coverage. This may reduce the total amount of highresolution cameras. Therefore, this system may reduce the capitalrequired to provide 360 degree photographic coverage of the wind farm byrequiring less hardware in the form of camera systems. The fewer camerasystems mounted within a wind farm may also reduce the amount ofsupporting network, further enabling cost savings.

FIGS. 10A-10E are exemplary representations of a graphical userinterface (GUI). The GUI may allow a person to interact with the smartdetection system. The person may monitor the actions taken by the systemand/or override decisions and enter decisions as necessary to providethe safety of a bird or bat and/or to prevent damage to the wind farm.The GUI may be produced by an application program operating on acomputing device. The computing device may have at least one displaydevice associated therewith. In some embodiments, the computing devicemay be associated with multiple display devices. The application mayproduce an application program window on the display device. In someembodiments, the application program window may be generated by theapplication program operating on the computing device. The applicationprogram window may display the GUI, which communicate select types ofinformation to a view of the GUI.

The computing device may be connected to a remote server over a network.The network may be a cloud computing network. The network mayadditionally include other networks which work to connect multiplecomputing devices, servers, and the like. The remote server may be acloud server or a dedicated server onsite at the physical location ofthe wind farm.

The GUI may represent one wind farm, or may optionally be connected tomultiple wind farms and may alternate or have the ability to alternatebetween at least a first and second wind farm. Thus, a person, such as ascientist, may interact with the GUI to access multiple wind farms.Accessing multiple wind farms may allow a single scientist to view aplethora of farms without the need to have a scientist employed at eachlocation. The GUI may provide the scientist with the option ofoverriding or updating information pertaining to events. In someembodiments, the GUI may additionally provide a summary of the wind farmsuch as name, location, potential species that may be encountered, etc.If multiple wind farms are accessible, the GUI may automatically switchto a wind farm when an event is generated. If multiple events areoccurring at once, the GUI may switch between each event location or asecond event may be directed to a second GUI. For example, multiplescientists or personnel may be interfacing with the GUI. A firstscientist may view a first event, a second scientist may view a secondevent, and the like.

The application program which displays the graphical interface may beable to automate the mitigation process. For example, the applicationprogram may classify the flying object and automatically partake inmitigation and/or deterrent activities as necessary. In someembodiments, the application program may not be accurate. Personnelinterfacing with the application program through the GUI may overridethe application program. For example, the personnel may update and/orcorrect a classification of the flying object and/or behavioralcharacteristics of the flying animal.

FIG. 10A depicts an exemplary representation of the GUI 142 for a smartdetection system. The GUI 142 may display a wind farm 132. The wind farm132 may include an individual representation of each wind tower 110. Ifthe system is using a cluster smart detection system, the location ofthe smart detection systems may also be displayed. The GUI 142 mayprovide labels for each individual wind tower and smart detection systemand may include any meteorological information. For example, FIG. 10Ashows a wind speed and direction 144. The GUI may additionally displayother meteorological information such as weather conditions (i.e., rain,snow, sleet, etc.) and the like. If a storm front is moving through theregion, the storm type may be displayed as well (i.e., hurricane,tornado, blizzard, derecho, etc.).

FIG. 10B depicts an exemplary representation of an airborne objectsighting. If an object 146 is detected, the screen border 148 may changecolor to provide a visual alert to an operator. The object 146 may thenappear on the GUI 142 displaying a representative size and direction.The GUI 142 may additionally identify a sector the object 146 istraveling in and speed 155. The object 146 sighting may generate anevent which may be recorded. A date and time of the event may bedisplayed 152. A secondary image 154 may appear which may provide visualrepresentation of the flying object. The visual representation may bestill images or may be video images. The secondary image 154 may appearon a second screen or may appear as a secondary image on the firstscreen.

The GUI 142 may visually change the display to represent the degree ofan alert. In some embodiments, the GUI 142 may use color to visuallyrepresent the degree of the alert. For example, a green border mayrepresent no event is occurring and operation is normal. A yellow bordermay indicate an object is within a predetermined distance of the windfarm and/or the mitigation volume. A red border may indicate mitigationefforts are required. A flashing red border may indicate a mishap hasoccurred and the flying object was struck. The colors described hereinare exemplary, any color scheme may be used. Additionally oralternatively, patterns may be used to display changing alerts.

FIG. 10C depicts an exemplary representation of classification of anobject 146 and mitigation activities. The classification 156 of theobject 146 may be depicted on the display. The travel information 150may also be updated as necessary. In this example, the object isclassified as a golden eagle and is continuing to travel along NW, DRIFTNE @3 M/S. If mitigation activities are activated, the activities 158may additionally be displayed on the screen. In this example, the goldeneagle is heading towards wind tower T2 and T3, therefore, the mitigationactivities 158 displays curtailment prescribed at these towers 110.

FIG. 10D depicts an exemplary representation of the GUI 142 tracking theobject 146 in a real time event. In this example, the travel directionof the golden eagle has changed as depicted both visually on the screenand in writing. As the direction of the golden eagle has changed, so toohas the mitigation activity warning 158. The secondary image 154 of thegolden eagle may provide additional behavioral information on the bird.For example, the golden eagle may have changed its behavior from ahunting mode to an aware flight mode. This may indicate the golden eaglehas become aware of the surroundings and may be exiting the wind farm.

FIG. 10E depicts an exemplary representation of the GUI 142 tracking ofthe object 146 in a real time event. In this example, the golden eaglehas exited the wind farm. The alert color of the border 148 may bedowngraded from a red color to a yellow color as active monitoring isoccurring. The event may still be recorded after the golden eagle hasexited the wind farm and may continue to be recorded until the goldeneagle is beyond a secondary safe zone. When this occurs, the event maybe concluded and all information recorded. If the golden eagle returned,a new event would be created and tracked.

FIG. 11 is a flow diagram of a method 200 of a potential mitigationeffort of a flying animal. A single detection system may perform all thesteps, or, in some embodiments, an array of detection systems mayperform the steps, or some combination thereof. In some instances, acentral database and/or cloud computing system may perform some of thesteps of the method 200. Additionally or alternatively, the method 200may provide a user interface to interact with a person who may interfacewith the computing system to initiate steps.

At block 205, the method 200 may detect a flying object. The flyingobject may be detected by one of the low resolution camera systems. Insome embodiments, multiple detection systems may detect the flyingobject. The detection of the object by the low resolution by activateone or more high resolution imaging systems to capture the flyingobject. The low resolution camera systems may be fixed systems thatcapture a predetermined area surrounding a detection system tower and/orwind tower. In some embodiments, the wind farm may be equipped with wideview imaging systems. The wide view imaging systems may allow fewer lowresolution cameras to be used while still providing complete image datacapture ability of the wind farm.

At block 210, the high resolution imaging systems may use multipletechniques to classify the object. For example, the high resolutionimaging system may use single images to classify the object. The method200 may additionally use multiple high resolution imaging systems toclassify the object. The multiple imagines may be combined to form astereoscopic image which may increase the accuracy of classifying theobject and behavior. Individual high resolution imaging systems maytransfer their image information to a central database such as a cloudserver for identification. The method 200 may additionally transmitother information collected by the detection systems such as radarinformation, meteorological information, and the like. The radarinformation may be collected using a radar system proximate a highresolution camera. The radar may provide accurate location dataregarding the flying object to ensure appropriate mitigation activitiesare undertaken. The meteorological information may includemeteorological data points collected through one or more meteorologicalinstruments proximate an image system. All of the information collectedby the systems may be streamed to a server, such as a cloud server, asthe information is gathered.

The cloud server may compile all of the information and transmit theinformation to a cloud server. The information may enable a cloud serverto make a positive classification. In some embodiments, as discussedfurther below, the cloud server may use a user interface to provide theclassification and detection information to a person such as a scientistfor further analysis. In some instances, the person may have the abilityto correct information of classification and behavior. Theclassification may include type of species, protected status, behavioralstatus, and the like. The cloud server may additionally be able toidentify a travel trajectory of the flying object and a travel speed.These data points may aid in potential mitigation should the flyingobject approach a wind farm.

At block 215, the method 200 may determine if the object requiresmonitoring. A flying animal may require monitoring if the flying animalmeets a threshold classification. The threshold classification mayinclude protected and/or endangered species of animals. The monitoringmay track the movements of the animal which may enable a mitigationefforts to prevent injury and/or death to the flying animal. In anotherinstance, the object may require monitoring if the object could damage awind turbine. For example, a large unmanned air vehicle (UAV) may havethe potential to cause damage to a wind tower and may requiremonitoring.

If the object does not require monitoring, then at block 220 the windfarm may continue its standard operation. An object may not requiremonitoring if it does not meet a threshold classification, a thresholdlocation, does not pose a threat to the windfarm, and the like. Athreshold location may include a predetermined distance from the windand/or a travel trajectory and speed. For example, the flying object mayinclude a flying animal that was captured by the detection system but istraveling away from the wind farm or is traveling at a trajectory thatwill not encounter the wind farm.

At block 225, the method 200 may include saving the data relating to thedetection event. The data may be saved to a local server or may bestored on a cloud server. The detection event data may providehistorical information for the wind farm, may provide information if amishap occurs, such as the death of a threshold animal, damage to thewind farm, and the like. The detection event data may additionally beused for capturing information pertaining to the wind farm andgenerating daily, monthly, annual reports, and the like. The reports mayprovide insight into the location of the wind farm. For example, if thedetection system is set up as an initial matter before the installationof a wind farm, the detection event information may provide informationto determine exact location of wind towers and/or if the location issuitable for a wind farm. If the detection system is set up before awind farm, the location of wind towers may be simulated such that theserver may run a simulated wind farm to determine whether the flyingobject may enter the proposed location of the wind farm.

If the object requires monitoring, then at block 230, the method 200 maymonitor the flying object. This may include monitoring the movement ofthe flying object. The movements may be monitored by a single system orby a plurality of systems such as an array of detection systems.Monitoring the movement may include monitoring the trajectory and travelspeed of the flying object, the location within the wind farm, and thelike. The flying object may also be monitored to determine if a statusof the object has changed. For example, a raptor may be hunting but maychange its behavioral status to traveling upon realization of the windturbines.

Part of monitoring the flying object may be, at block 235, determiningif the object is approaching and/or entering a wind farm and/or amitigation volume surrounding a wind turbine. If the flying object isapproaching the wind farm, at block 240, the method 200 may activatemitigation standards. The mitigation standards may include terminatingblade functionality of a wind tower and/or activating deterrenttechnology. The blade functionality may include reducing the blade speedto 0 RPM or an alternative safe spinning speed. The deterrent technologymay include flashing lights and/or noises to scare the flying objectaway from the wind towers. A single wind tower may perform thisfunctionality alone, or may work in conjunction with an array ofdetection systems and wind towers to complete the process.

During the mitigation standards, the method 200 may continue to monitorthe movements of the flying object. If the flying object does not exitthe wind farm, at block 250, the method 200 may continue mitigationstandards and continue to monitor the flying object until the objectexits the wind farm. If, at block 245, the method 200 detects the objectexiting the wind farm, the method 200, at block 220, may continuestandard operation of the wind farm and, at block 225, save the datafrom the event. Saving the information may include generating an eventlog of the flying objects journey through the wind farm. This mayinclude classification of the object, initial behavior and anybehavioral changes, trajectory, travel speed, quantity if there is morethan one, and the like. The information may additionally include anymitigation efforts. The mitigation efforts may include detailedinformation of wind turbine curtailment. The curtailment may include alocation of the flying object when the curtailment was initiated, thedetails of curtailment (curtailment to zero or to a reduced speed),resumption of operation, and the like. Mitigation efforts mayadditionally include any deterrent methods such as flashing lights ornoises initiating to deter a flying object from entering the wind farmor approaching a wind turbine. The event information may further includea time and date of the event and if any override procedures wereenacted. For example, a computer may have misclassified the object orits behavior and a person may have overridden the classification.Similarly, the computer may have either initiated or not initiatedcurtailment or deterrent procedures when personnel may have deemed itnecessary and manually requested the mitigation procedures. All of theevent information may be stored on a server. The server may be a localserver, a cloud server, or some combination thereof.

FIG. 12 depicts an example of a method 300 pertaining to a detectionsystem. In this example, the method 300 includes monitoring 302 anairborne object, determining 304 whether the airborne object is enteringor already within the protected space, performing 306 behaviorassessment of the airborne object, categorizing 308 the airborneobject's behavior, determining 310 whether the behavior is high risk,determining 312 whether the behavior meets a criterion, and sending 314a command to execute a mitigation protocol.

At block 302, the airborne object is monitored. In some examples, theairborne object is spotted through a low resolution camera, a highresolution camera, a plurality of cameras, or combinations thereof. Insome examples, the airborne object is monitored with other types ofequipment besides just cameras. For example, the airborne object may bemonitored with the use of microphones, radar systems, distance cameras,thermal sensors, other types of equipment, or combinations thereof

At block 304, the system determines whether the airborne object isentering the protected space or is already in the protected space. Ifthe airborne object is not in the protected space, the system continuesto monitor the airborne object. On the other hand, if the airborneobject is either entering the protected space or is already in theprotected space, the airborne object's behavior is analyzed.

At block 306, the airborne object's behavior is analyzed. In exampleswhere the airborne object is a bird, the system may take note about thebird's flying characteristics, such as whether the bird is soaring,gliding, flapping, and so forth. Also, the system may take notice ofwhether the bird's head is up or down. Further, the system may take noteof any behavior that may indicate whether the bird is hunting,migrating, performing another type of activity, or combinations thereof

At block 308, the behavior of the airborne object is categorized.Continuing with examples of the airborne object being a bird, thecategories may include details that help the system determine whetherthe bird vulnerable to be injured or killed by the wind farm. Suchcategories may include a hunting category, a migrating category, anothertype of category, or combinations thereof. Such categories may includesubcategories that give more detail that describes the bird's behavior.

At block 310, the system determines whether the airborne object'sbehavior is a high risk. The system may make this determination based onhistorical trends attributed to the assigned category described above.Further, more than just the airborne object's behavior may be analyzed.For example, the weather conditions, operational status of the windfarm, environmental conditions, the airborne objects direction oftravel, and other types of factors may be analyzed to determine whetherthere is a high risk that the airborne object will be injured, killed,damaged, destroyed, or combinations thereof. If the risk is low, thenthe system may continue to monitor the airborne object. On the otherhand, if the risk is high, the system determines whether the airborneobject's behavior meets a criterion associated with activating themitigation system.

At block 312, the system determines whether the airborne object'sbehavior meets the criterion. In this case, if the airborne object'sbehavior does not meet the criterion, the system will repeat portions ofthe method beginning at determining again whether the airborne object isstill in the protected area. On the other hand, if the airborne object'sbehavior does meet the criterion, a command may be sent to at least oneof the windmill towers to initiate a mitigation procedure.

At block 314, a command is sent to at least one of the windmill towersto initiate a mitigation procedure/curtailment procedure. In someexamples, a signal may be sent to an operator whether the operatordecides whether to initiate a curtailment procedure, a determentprocedure, or another type of mitigation procedure. In other examples, acommand signal is sent directly to at least one windmill tower toinitiate the selected procedure without human involvement.

While the examples above have been described with specific wind farms,any appropriate wind farm may be used in accordance with the principlesdescribed herein. For example, just some of the towers in the wind farmmay include turbine blades. The other towers in the wind farm may bededicated to other purposes. For example, at least one tower may beincluded in the wind farm that is dedicated to just airborne objectdetection. This type of tower may include a high resolution camera, alow resolution camera, another type of camera, or combinations thereof.In other examples, each of the towers in the wind farm are equipped withwind turbines. Further, in some examples, each of the wind towers areequipped with camera, but in other examples a subset of the wind towersinclude cameras.

A server may be incorporated in any appropriate tower, such as adedicated airborne object detection tower, a wind tower, or other typeof tower. In some cases, the server is not located in the wind farm, butis in wireless communication with the towers in the wind farm.

While the examples above have been described with reference to specificexamples of risk mitigation, any appropriate type of risk mitigation maybe employed in accordance to the principles described herein. Forexamples, the risk mitigation may involve determent systems such asemploying lights and sounds to cause airborne animals to leave the windfarm. In other examples, the mitigation system may include curtailmentprocedures where the turbine speed is reduced and/or stopped. In yetother examples where the airborne object is a drone or another type ofinanimate object, the airborne object may be disabled throughelectromagnetic mechanisms, lasers, jamming signals, guns, projectiles,other types of mechanisms, or combinations thereof

While the protected areas have been described as wind farms, anyappropriate type of wind farm may be used in accordance with theprinciples described in the present disclosure. For example, theprotected area may include an airport, a prison, a stadium, a researchfacility, a building, a solar farm, a developmental area, an area ofinterest, a construction site, a national monument, a national park,another type of protected area, any designated area, or combinationsthereof.

This disclosure is illustrative and not limiting. Further modificationswill be apparent to one skilled in the art in light of this disclosureand are intended to fall within the scope of the appended claims.

1-20. (canceled)
 21. A method of analyzing an airborne object movementin a designated area, the method comprising the steps of: monitoringairspace in all approachable directions around the designated area witha plurality of wide field of view cameras connected to a detection towerand configured to provide a substantially hemispherical mitigationvolume surrounding and extending above the detection tower; detectingthe airborne object through a wide field of view camera; activating atracking camera connected to the detection tower to track the airborneobject; obtaining a high resolution image of the airborne object withthe tracking camera; transmitting, automatically through a computingdevice, the high resolution image to a server; classifying, through theserver, the airborne object based at least in part on the highresolution image; and monitoring the airborne object with the trackingcamera as the airborne object enters the designated area for theairborne object satisfying a set of characteristics from the classifyingstep.
 22. The method of claim 21, further comprising the step ofclassifying the airborne object as at least one of a predeterminedliving species or an inanimate object.
 23. The method of claim 22,further comprising the step of activating mitigation efforts within thedesignated area when the airborne object meets a thresholdclassification and a threshold location.
 24. The method of claim 23,wherein the mitigation efforts uses a mitigation system to disable aninanimate object, the mitigation system comprising: an electromagnetictransmitter, a laser, a jamming signal transmitter, a gun, a projectile,or a combination thereof.
 25. The method of claim 23, wherein theairborne object is an airborne animal, the designated area correspondsto a windfarm, and the mitigation efforts comprises curtailing one ormore wind turbines.
 26. The method of claim 21, wherein the airborneobject is a drone or aircraft.
 27. The method of claim 26, wherein thedesignated area is an airport, a prison, a stadium, a research facility,a wind farm, a solar farm, a developmental area, a construction site, anational monument, a national park, or combinations thereof.
 28. Themethod of claim 21, wherein the step of activating the tracking camerato track the airborne object occurs for the airborne object that is at adistance of 600 m or greater from the detection tower.
 29. The method ofclaim 21, wherein each wide field of view camera has a field of viewthat partially overlaps with another wide field of view camera.
 30. Themethod of claims 21, wherein the activating the tracking camera stepcomprises controlling a positioner to rotate and tilt the trackingcamera to continuously track a moving airborne object.
 31. The method ofclaim 30, wherein the positioner is a pan and tilt system.
 32. Themethod of claim 21, further comprising the step of measuring a distanceto the airborne object by using a second tracking camera to form astereoscopic image with an image from the tracking camera.
 33. Themethod of claim 21, further comprising the step of measuring a distanceto the airborne object by using one or more of: a range finder; a radar;or a second.
 34. The method of claim 21, further comprising the step oftracking the airborne object with a radar system to improve locationdetermination of the airborne object.
 35. The method of claim 21,wherein the wide field of view cameras are in a fixed position.
 36. Themethod of claim 21, wherein the wide field of view cameras generatedimages from visible light or from infrared light.
 37. The method ofclaim 21, further comprising the step of deploying a deterrent measureto deter a living moving object from approaching a wind turbinepositioned in the designated area.
 38. The method of claim 21, whereinthe detection tower is a wind turbine tower.
 39. The method of claim 21,wherein the detection tower is a stand-alone tower.